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DETAILED ACTION 

Continued Examination Under 37 CFR Id 14 

1. A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.1 14. Applicants submission filed on 9/18/2003 (paper no. 8) has been entered. 

Response to Amendment 

2. This office is in response to the amendment filed 10/27/2003 (paper no. 12). 

Information Disclosure Statement 

3. The information disclosure statement (IDS) submitted on 9/18/2003 (paper no. 10) was 
filed after the mailing date of the final rejection on 6/18/2003 (paper no. 7). The submission is in 
compliance with the provisions of 37 CFR 1.97. Accordingly, the information disclosure 
statement is being considered. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
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having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the 
claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of the various 
claims was commonly owned at the time any inventions covered therein were made absent any 
evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1.56 to point out 
the inventor and invention dates of each claim that was not commonly owned at the time a later 
invention was made in order for the examiner to consider the applicability of 35 U.S.C. 103(c) 
and potential 35 U.S.C. 102(e), (f) or (g) prior art under 35 U.S.C. 103(a). 

5. Claims 1-9, 15-23 and 25-30 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Ippolito et al. (US PAT. 6,072,522 hereinafter Ippolito) in view of McCall et al. (US PAT. 
6,002,430 hereinafter McCall). 

Regarding claim 1, Ippolito discloses an automated system (100, figure 2) for capturing 
and viewing an event having event participants comprising a camera system (130, figure 2) for 
providing image of the event and that simultaneously and automatically tracks the event 
participants to determine the event participants that are speaking using audio analysis and film 
the event (col. 8 lines 1-23 and col. 8 line 51 through col. 10 line 59), and an automated online 
broadcasting system (16, figure 2) for controlling and using the camera system to monitor each 
of the tracked event participants simultaneously and broadcasting the events (col. 6 line 66 
through col. 7 line 6). Note while Ippolito teaches to exchange audio and video information from 
the automated system to remote participants in a videoconference via a communication network 
(col. 6 line 66 through col. 7 line 24). Thus, it recognizes the automated system further 
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comprising a viewer platform in communication with the automated online broadcasting system 
that allows the remote participants to view the broadcasted event. Ippolito differs from the 
claimed invention in not specifically teaching the camera system comprising a seamless omni- 
directional camera system that provides a seamless omni-directional image. However, McCcall 
teaches a camera system for forming a seamless spherical image, i.e., a seamless omni- 
directional image, from captured image or images by cameras in order to provide a maximum 
amount of viewing coverage without the bulk of additional cameras (col. 3 line 32 through col. 6 
line 42 and col. 7 line 38 through col. 9 line 39). Therefore, it would have been obvious to a 
person of ordinary skill in the art at the time the invention was made to modify Ippolito in using 
the seamless omni-directional camera system, as per teaching of McCall, because it improves the 
automated event presentation system by providing the maximum amount of viewing coverage 
without the bulk of additional cameras. 

Regarding claims 2-4, McCall teaches the camera including a wide-angle imaging device, 
wherein the wide-angle imaging device providing an approximately 180-degree field-of-view so 
that the camera system including to combine a plurality of cameras to provide an approximately 
360-degree field-of-view (figure 6A, col. 7 lines 38-44 and col. 8 lines 32-42). In addition, 
McCall also teaches to use a camera having a wide-angle view approximately 360 degrees in 
order to eliminate the bulk of an additional camera (figure 6B and col. 10 lines 41-46). 

Regarding claim 5, Ippolito discloses a switching module for allowing switching between 
of the image of the event (col. 13 lines 53-67). 
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Regarding claim 6, McCall teaches the omni-directional camera system for providing a 
high-resolution image (col. 8 lines 54-63) so that it recognizes the omni-directional camera 
system having a resolution of approximately 1000 by 1000 pixels. 

Regarding claim 7, Ippolito teaches the camera control system further comprising means 
for finding and indexing the event participants (col. 10 lines 14-46). 

Regarding claim 8, Ippolito discloses a method for filming and recording an event having 
event participants and presenting the event to a viewer, comprising the steps of using a camera 
system (130, figure 2) for filming and recording the event to provide an image that contains the 
event participants (col. 7 lines 38-62), and automatically determining a location of the event 
participant in the image by using a speaker detection technique to determine the event 
participants that are speaking (col. 8 lines 1-23 and col. 8 line 51 through col. 10 line 59). Note 
while Ippolito teaches to exchange audio and video information from the automated system to 
remote participants in a videoconference via a communication network (col. 6 line 66 through 
col. 7 line 24). Thus, it recognizes the automated system comprising a user interface that allows a 
choice of which of the event participants to view automatically by a virtual director. In addition, 
it is old and notoriously well known in the art of using a manual user interface for choosing of 
which of the event participants to view. Furthermore, Ippolito teaches to switch instantaneously 
between views of the event participants in the image in response to the choice (col. 7 line 63 
through col. 8 line 23 and col. 13 lines 53-67). Ippolito differs from the claimed invention in not 
specifically teaching the camera system comprising a seamless omni-directional camera system 
that provides a seamless omni-directional image. However, McCcall teaches a camera system for 
forming a seamless spherical image, i.e., a seamless omni-directional image, from captured 
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image or images by cameras in order to provide a maximum amount of viewing coverage 
without the bulk of additional cameras (col. 3 line 32 through col. 6 line 42 and col. 7 line 38 
through col. 9 line 39). Therefore, it would have been obvious to a person of ordinary skill in the 
art at the time the invention was made to modify Ippolito in using the seamless omni-directional 
camera system, as per teaching of McCall, because it improves the automated event presentation 
system by providing the maximum amount of viewing coverage without the bulk of additional 
cameras. 

Regarding claim 9, Ippolito teaches video conferencing management device for 
managing the exchange of the various audio and video information over a communication 
network (col. 5 lines 39-45) so that it recognizes the video conferencing management device 
functions as a computer having computer-executable instructions for performing an operation. 

Regarding claims 15-16, Ippolito teaches the speaker detection technique including 
microphone array sound source localization technique that use a microphone array (120, figure 
2) and sound source localization algorithms (col. 9 line 42 through col. 10 line 46), and using the 
speaker detection technique to follow event participants that are speaking by switching from on 
camera view to another camera view (col.(col. 13 lines 53-67). 

Regarding claim 17, McCall discloses the omni-directional camera system being one of a 
single panoramic camera and an array camera having an approximately 360-degree field-of-view 
(figures 6A-6B). 

Regarding claim 18, Ippolito discloses a method for filming and recording an event 
having event participants and presenting the event to a viewer, comprising the steps of using a 
camera system (130, figure 2) for filming and recording the event to provide an image that 
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contains the event participants (col. 7 lines 38-62), transmitting images from a broadcasting 
platform (16, figure 2) to a viewer platform using a electronic communication network, i.e., a 
computer network (col. 6 line 66 through col. 7 line 24), and switch instantaneously between 
views of the event participants in the image in response to the choice (col. 7 line 63 through col. 
8 line 23 and col. 13 lines 53-67). Note while Ippolito teaches to exchange audio and video 
information from the automated system to remote participants in a videoconference via a 
communication network (col. 6 line 66 through col. 7 line 24) and it is old and notoriously well 
known in the art of using a manual user interface in a remote location for choosing of which of 
the event participants to view. Thus, it recognizes Ippolito obviously in using the view platform 
to allow a remote viewer to select which of the image the remote view would like to view in 
order to make user friendly. Ippolito differs from the claimed invention in not specifically 
teaching the camera system comprising a seamless omni-directional camera system that provides 
a seamless omni-directional image. However, McCcall teaches a camera system for forming a 
seamless spherical image, i.e., a seamless omni-directional image, from captured image or 
images by cameras in order to provide a maximum amount of viewing coverage without the bulk 
of additional cameras (col. 3 line 32 through col. 6 line 42 and col. 7 line 38 through col. 9 line 
39). Therefore, it would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to modify Ippolito in using the seamless omni-directional camera system, as 
per teaching of McCall, because it improves the automated event presentation system by 
providing the maximum amount of viewing coverage without the bulk of additional cameras. 

Regarding claim 19, McCall teaches the viewer selecting to view to view multiple 
portions of the omni-directional image (col. 1 1 lines 8-25). 



Application/Control Number: 09/68 1 ,843 Page 8 

Art Unit: 2643 

Regarding claim 20, Ippolito teaches to contain all event participants within the event 
environment (col. 3 lines 41-45). 

Regarding claim 21, Ippolito discloses a method for filming and recording an event 
having event participants and presenting the event to a viewer, comprising the steps of using a 
camera system (130, figure 2) for providing an image of the event (col. 7 lines 38-62), and an 
automated online broadcasting system (16, figure 2) for controlling and using the camera system 
to monitor each of the tracked event participants simultaneously and broadcasting the events 
(col. 6 line 66 through col. 7 line 6) so that the automated on line broadcasting system obviously 
comprising a virtual director module for determining which of the camera views to display on 
the viewer platform by applying a set of expert production rules based at least in part on a 
display history of an event participant, i.e., selecting a camera based on event participant is 
currently speaking. Note while Ippolito also teaches to exchange audio and video information 
from the automated system to remote participants in a videoconference via a computer network 
(col. 6 line 66 through col. 7 line 24). Thus, it recognizes a view platform in communicate the 
computer network for receiving the image. Ippolito differs from the claimed invention in not 
specifically teaching the camera system comprising a seamless omni-directional camera system 
that provides a seamless omni-directional image. However, McCcall teaches a camera system for 
forming a seamless spherical image, i.e., a seamless omni-directional image, from captured 
image or images by cameras in order to provide a maximum amount of viewing coverage 
without the bulk of additional cameras (col. 3 line 32 through col. 6 line 42 and col. 7 line 38 
through col. 9 line 39). Therefore, it would have been obvious to a person of ordinary skill in the 
art at the time the invention was made to modify Ippolito in using the seamless omni-directional 
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camera system, as per teaching of McCall, because it improves the automated event presentation 
system by providing the maximum amount of viewing coverage without the bulk of additional 
cameras. 

Regarding claim 22, Ippolito teaches to provide switching between the multiple camera 
views of the event (col. 13 lines 53-67). 

Regarding claim 23, Ippolito teaches to switch instantaneously between multiple camera 
views (col. 7 line 63 through col. 8 line 23 and col. 13 lines 53-67). 

Regarding claim 25, Ippolito teaches to require no physical movement to capture the 
event participants (col. 3 line 57 through col. 4 line 5), as well as McCall (col. 3 lines 55-58). 

Regarding claims 26-27, Ippolito teaches to exchange audio and video information from 
the automated system to remote participants in a videoconference via a communication network 
(col. 6 line 66 through col. 7 line 24) and it is old and notoriously well known in the art of using 
a manual user interface in a remote location for choosing of which of the event participants to 
view. Thus, it recognizes Ippolito in having a user interface on the viewer platform allowing an 
arbitrary number of viewers to view an arbitrary number of viewpoints of the broadcasted event 
so that instantaneous switching is supported for an infinite number of viewers that select 
arbitrary different viewpoints. 

Regarding claim 28, Ippolito differs from the claimed invention in not specifically 
teaching to transmit a low-resolution version of the omni-directional image to the viewer 
platform, wherein the omni-directional image produced by the omni-directional camera system is 
a high-resolution omni-directional image and to transmit a high-resolution version of the selected 
portion of the omni-direction image to the viewer platform. However, McCall teaches such (col. 
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13 lines 26-53 and col. 16 line 30 through col. 17 line 13). Therefore, it would have been obvious 
to a person of ordinary skill in the art at the time the invention was made to modify Ippolito in 
transmitting the low-resolution version of the omni-directional image to the viewer platform and 
transmitting the high-resolution version of the selected portion of the omni-direction image to the 
viewer platform, as per teaching of McCall, in order to provide capabilities associated with 
traditional mechanical pan, tilt, rotation and zoom devices. 

Regarding claim 29, the limitations of the claim are rejected as the same reasons set forth 
in claim 8. 

Regarding claim 30, Ippolito teaches to exchange audio and video information from the 
automated system to remote participants in a videoconference via a communication network (col. 
6 line 66 through col. 7 line 24) and it is old and notoriously well known in the art of using a 
manual user interface in a remote location for choosing of which of the event participants to 
view, thereby it allows a plurality of viewers to simultaneously view different views. 

6. Claims 10-13 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ippolito et 
al. (US PAT. 6,072,522 hereinafter Ippolito) in view of McCall et al. (US PAT. 6,002,430 
hereinafter McCall) as applied in claim 8 above, and further in view of Kannes (US PAT. 
5,382,972). 

Regarding claims 10-13, the combination of Ippolito and McCall differs from the claimed 
invention in not specifically teaching to store annotation associated with the event and 
synchronizing this annotations with the event for allowing the view to select which of the 
annotation to store while the event is occurring or after the event occurring, wherein the 
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annotations is a digital chat regarding the event. However, Kannes teaches such (col. 11 line 10 
throguh col. 13 line 36). Therefore, it would have been obvious to a person of ordinary skill in 
the art at the time the invention was made to modify the combination of Ippolito and McCall in 
storing annotation associated with the event and synchronizing this annotations with the event 
for allowing the view to select which of the annotation to store while the event is occurring or 
after the event occurring, wherein the annotations is a digital chat regarding the event, as per 
teaching of Kannes, in order to make user friendly. 

7. Claim 24 is rejected under 35 U.S.C. 103(a) as being unpatentable over Ippolito et al. 
(US PAT. 6,072,522 hereinafter Ippolito) in view of McCall et al. (US PAT. 6,002,430 
hereinafter McCall) as applied in claim 21 above, and further in view of Bruno et al. (US PAT. 
5,710,591) hereinafter Bruno). 

Regarding claim 24, the combination of Ippolito and McCall differs from the claimed 
invention in not specifically teaching to provide negative switching that allows switching to a 
camera view of a person speaking before begins to speak, i.e., negative swithcing. However, 
Bruno teaches such (col. 4 line 62 through col. 5 line 7). Therefore, it would have been obvious 
to a person of ordinary skill in the art at the time the invention was made to modify the 
combination of Ippolito and McCall in switching to a camera view of a person speaking before 
begins to speak, as per teaching of Bruno, because it makes user friendly for subsequent retrieval 
and processing. 
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Response to Arguments 

8. Applicant's arguments with respect to claims 1-13 and 15-30 have been considered but 
are moot in view of the new ground(s) of rejection. 

Conclusion 

9. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. Jouppi (US PAT. 6,346,950) discloses a robotic telepresence system responsive to a 
user to communicate information with the user station (col. 3 line 34 through col.5 line 47). 
Hildin (US PAT. 5,844,599) discloses a voice following video system (abstract). 

10. Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 

Washington, D.C. 20231 
Or faxed to: 

(703) 872-9314 (for Technology Center 2600 only) 
Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal Drive, 
Arlington, VA, Sixth Floor (Receptionist). 

11. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to George Eng whose telephone number is (703) 308-9555. The 
examiner can normally be reached on Tuesday to Friday from 7 AM to 5:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mr. Curtis Kuntz, can be reached on (703) 305-4708. 



Ap'plication/Control Number: 09/681,843 
Art Unit: 2643 



Page 13 



Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the Technology Center 2600 Customer Service Office whose telephone 
number is (703) 306-0377. 




George Eng 
Primary Examiner 
Art Unit 2643 



